Pandas Profiling Report

Dataset statistics

Number of variables	11
Number of observations	53197
Missing cells	0
Missing cells (%)	0.0%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	7.2 MiB
Average record size in memory	142.0 B

Variable types

NUM	8
BOOL	2
CAT	1

Reproduction

Analysis started	2020-03-01 12:09:52.661693
Analysis finished	2020-03-01 12:12:04.192799
Version	pandas-profiling v2.5.0
Command line	`pandas_profiling --config_file config.yaml [YOUR_FILE.csv]`
Download configuration	config.yaml

`LowUserPrice` is highly skewed (γ1 = 72.56560029)	Skewed
`LowNetPrice` is highly skewed (γ1 = 78.1880364)	Skewed
`ReleaseNumber` has 4550 (8.6%) zeros	Zeros
`PriceReg` has 976 (1.8%) zeros	Zeros
`LowUserPrice` has 6431 (12.1%) zeros	Zeros
`LowNetPrice` has 1579 (3.0%) zeros	Zeros

SKU_number
Real number (ℝ_≥0)

UNIQUE

Distinct count	53197
Unique (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	652619.6144
Minimum	50001
Maximum	3959831
Zeros	0
Zeros (%)	0.0%
Memory size	415.7 KiB

Quantile statistics

Minimum	50001
5-th percentile	54671.6
Q1	170005
median	540957
Q3	759710
95-th percentile	2407744.2
Maximum	3959831
Range	3909830
Interquartile range (IQR)	589705

Descriptive statistics

Standard deviation	687327.1684
Coefficient of variation (CV)	1.053181904
Kurtosis	4.169920642
Mean	652619.6144
Median Absolute Deviation (MAD)	453234.278
Skewness	2.067154779
Sum	3.471740563e+10
Variance	4.724186364e+11

Histogram
Dynamic Histogram

Histogram with fixed size bins (bins=10)

Histogram with variable size bins (bins=[ 50001. 55752.5 58568.5 60002. 61260.5 ... 3635024.5 3744666. 3834147. 3959830. 3959831. ], "bayesian blocks" binning strategy used)

Value	Count	Frequency (%)
530429	1	< 0.1%
545951	1	< 0.1%
755396	1	< 0.1%
206001	1	< 0.1%
119983	1	< 0.1%
902317	1	< 0.1%
642220	1	< 0.1%
652459	1	< 0.1%
105638	1	< 0.1%
218677	1	< 0.1%
Other values (53187)	53187	> 99.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
50001	1	< 0.1%
50002	1	< 0.1%
50003	1	< 0.1%
50004	1	< 0.1%
50006	1	< 0.1%

Value	Count	Frequency (%)
3959831	1	< 0.1%
3959829	1	< 0.1%
3951300	1	< 0.1%
3951290	1	< 0.1%
3951231	1	< 0.1%

MarketingType
Categorical

Distinct count	2
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	415.7 KiB

S	28633
D	24564

Value	Count	Frequency (%)
S	28633	53.8%
D	24564	46.2%

Length

Max length	1
Mean length	1
Min length	1

Value	Count	Frequency (%)
Uppercase_Letter	2	100.0%

Value	Count	Frequency (%)
Latin	2	100.0%

Value	Count	Frequency (%)
ASCII	2	100.0%

ReleaseNumber
Real number (ℝ_≥0)

ZEROS

Distinct count	58
Unique (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	4.125796567
Minimum	0
Maximum	99
Zeros	4550
Zeros (%)	8.6%
Memory size	415.7 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	2
median	3
Q3	6
95-th percentile	11
Maximum	99
Range	99
Interquartile range (IQR)	4

Descriptive statistics

Standard deviation	3.895184175
Coefficient of variation (CV)	0.9441047593
Kurtosis	31.66739068
Mean	4.125796567
Median Absolute Deviation (MAD)	2.731417112
Skewness	3.331137132
Sum	219480
Variance	15.17245976

Histogram
Dynamic Histogram

Histogram with fixed size bins (bins=10)

Histogram with variable size bins (bins=[ 0. 0.5 1.5 2.5 3.5 ... 25.5 35.5 44.5 52.5 99. ], "bayesian blocks" binning strategy used)

Value	Count	Frequency (%)
2	11278	21.2%
3	7333	13.8%
1	6715	12.6%
4	5241	9.9%
0	4550	8.6%
5	4176	7.9%
6	3336	6.3%
7	2630	4.9%
8	2057	3.9%
9	1590	3.0%
Other values (48)	4291	8.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	4550	8.6%
1	6715	12.6%
2	11278	21.2%
3	7333	13.8%
4	5241	9.9%

Value	Count	Frequency (%)
99	1	< 0.1%
97	1	< 0.1%
82	1	< 0.1%
66	1	< 0.1%
58	1	< 0.1%

New_Release_Flag
Boolean

Distinct count	2
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	415.7 KiB

1	41932
0	11265

Frequency Table

Value	Count	Frequency (%)
1	41932	78.8%
0	11265	21.2%

StrengthFactor
Real number (ℝ_≥0)

Distinct count	52505
Unique (%)	98.7%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	1216756.574
Minimum	68
Maximum	16669658
Zeros	0
Zeros (%)	0.0%
Memory size	415.7 KiB

Quantile statistics

Minimum	68
5-th percentile	35014.6
Q1	243225
median	715500
Q3	1552432
95-th percentile	4136155.8
Maximum	16669658
Range	16669590
Interquartile range (IQR)	1309207

Descriptive statistics

Standard deviation	1524906.895
Coefficient of variation (CV)	1.253255522
Kurtosis	12.55169626
Mean	1216756.574
Median Absolute Deviation (MAD)	1027351.915
Skewness	2.892325144
Sum	6.472779946e+10
Variance	2.32534104e+12

Histogram
Dynamic Histogram

Histogram with fixed size bins (bins=10)

Histogram with variable size bins (bins=[6.80000000e+01 1.73450000e+03 5.99805000e+04 1.14373000e+05 1.47962500e+05 ... 7.42892900e+06 9.80970050e+06 1.12440185e+07 1.27598820e+07 1.66696580e+07], "bayesian blocks" binning strategy used)

Value	Count	Frequency (%)
3158	3	< 0.1%
586672	3	< 0.1%
12815	3	< 0.1%
129992	3	< 0.1%
29717	3	< 0.1%
209753	3	< 0.1%
58655	3	< 0.1%
27028	3	< 0.1%
1080008	2	< 0.1%
1059564	2	< 0.1%
Other values (52495)	53169	99.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
68	1	< 0.1%
113	1	< 0.1%
193	1	< 0.1%
200	1	< 0.1%
227	1	< 0.1%

Value	Count	Frequency (%)
16669658	1	< 0.1%
16428309	1	< 0.1%
16411446	1	< 0.1%
15661005	1	< 0.1%
15599056	1	< 0.1%

PriceReg
Real number (ℝ_≥0)

ZEROS

Distinct count	7464
Unique (%)	14.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	99.00402598
Minimum	0
Maximum	3986.31
Zeros	976
Zeros (%)	1.8%
Memory size	415.7 KiB

Quantile statistics

Minimum	0
5-th percentile	18.928
Q1	49.95
median	78.95
Q3	127.95
95-th percentile	242.95
Maximum	3986.31
Range	3986.31
Interquartile range (IQR)	78

Descriptive statistics

Standard deviation	80.63133269
Coefficient of variation (CV)	0.8144247862
Kurtosis	215.1874619
Mean	99.00402598
Median Absolute Deviation (MAD)	54.46563708
Skewness	7.318281322
Sum	5266717.17
Variance	6501.411811

Histogram
Dynamic Histogram

Histogram with fixed size bins (bins=10)

Histogram with variable size bins (bins=[0.000000e+00 5.000000e-03 3.975000e+00 4.020000e+00 4.965000e+00 ... 5.987900e+02 5.992450e+02 6.135350e+02 1.086105e+03 3.986310e+03], "bayesian blocks" binning strategy used)

Value	Count	Frequency (%)
0	976	1.8%
49.95	727	1.4%
39.95	566	1.1%
49.99	503	0.9%
59.95	497	0.9%
69.95	401	0.8%
44.95	392	0.7%
39.99	375	0.7%
79.95	360	0.7%
75	333	0.6%
Other values (7454)	48067	90.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	976	1.8%
0.01	1	< 0.1%
0.34	1	< 0.1%
0.5	1	< 0.1%
1	2	< 0.1%

Value	Count	Frequency (%)
3986.31	1	< 0.1%
2800	1	< 0.1%
2707.22	1	< 0.1%
2645.3	1	< 0.1%
2432.64	1	< 0.1%

ReleaseYear
Real number (ℝ_≥0)

Distinct count	66
Unique (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	2005.971389
Minimum	1945
Maximum	2016
Zeros	0
Zeros (%)	0.0%
Memory size	415.7 KiB

Quantile statistics

Minimum	1945
5-th percentile	1995
Q1	2003
median	2007
Q3	2010
95-th percentile	2013
Maximum	2016
Range	71
Interquartile range (IQR)	7

Descriptive statistics

Standard deviation	6.098044798
Coefficient of variation (CV)	0.003039946048
Kurtosis	6.202119143
Mean	2005.971389
Median Absolute Deviation (MAD)	4.461849698
Skewness	-1.772564234
Sum	106711660
Variance	37.18615036

Histogram
Dynamic Histogram

Histogram with fixed size bins (bins=10)

Histogram with variable size bins (bins=[1945. 1961.5 1968.5 1977.5 1981.5 ... 2012.5 2013.5 2014.5 2015.5 2016. ], "bayesian blocks" binning strategy used)

Value	Count	Frequency (%)
2010	4367	8.2%
2008	4200	7.9%
2009	4126	7.8%
2007	4064	7.6%
2006	3899	7.3%
2011	3886	7.3%
2005	3563	6.7%
2012	3436	6.5%
2004	3008	5.7%
2013	2585	4.9%
Other values (56)	16063	30.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1945	1	< 0.1%
1950	2	< 0.1%
1952	2	< 0.1%
1953	1	< 0.1%
1954	1	< 0.1%

Value	Count	Frequency (%)
2016	48	0.1%
2015	397	0.7%
2014	1655	3.1%
2013	2585	4.9%
2012	3436	6.5%

ItemCount
Real number (ℝ_≥0)

Distinct count	379
Unique (%)	0.7%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	43.94165084
Minimum	0
Maximum	1426
Zeros	53
Zeros (%)	0.1%
Memory size	415.7 KiB

Quantile statistics

Minimum	0
5-th percentile	13
Q1	22
median	34
Q3	53
95-th percentile	107
Maximum	1426
Range	1426
Interquartile range (IQR)	31

Descriptive statistics

Standard deviation	37.51590055
Coefficient of variation (CV)	0.8537662976
Kurtosis	82.52224851
Mean	43.94165084
Median Absolute Deviation (MAD)	23.40039562
Skewness	5.468709865
Sum	2337564
Variance	1407.442794

Histogram
Dynamic Histogram

Histogram with fixed size bins (bins=10)

Histogram with variable size bins (bins=[0.000e+00 5.000e-01 4.500e+00 6.500e+00 8.500e+00 ... 2.730e+02 3.075e+02 3.960e+02 6.565e+02 1.426e+03], "bayesian blocks" binning strategy used)

Value	Count	Frequency (%)
20	1344	2.5%
18	1344	2.5%
21	1341	2.5%
22	1326	2.5%
19	1318	2.5%
24	1304	2.5%
25	1249	2.3%
23	1230	2.3%
26	1187	2.2%
17	1175	2.2%
Other values (369)	40379	75.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	53	0.1%
1	19	< 0.1%
2	18	< 0.1%
3	23	< 0.1%
4	29	0.1%

Value	Count	Frequency (%)
1426	1	< 0.1%
930	1	< 0.1%
851	1	< 0.1%
827	1	< 0.1%
816	1	< 0.1%

LowUserPrice
Real number (ℝ_≥0)

SKEWED
ZEROS

Distinct count	10425
Unique (%)	19.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	56.45553715
Minimum	0
Maximum	14140.21
Zeros	6431
Zeros (%)	12.1%
Memory size	415.7 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	20.19
median	44
Q3	79.59
95-th percentile	146.05
Maximum	14140.21
Range	14140.21
Interquartile range (IQR)	59.4

Descriptive statistics

Standard deviation	99.00628973
Coefficient of variation (CV)	1.753703794
Kurtosis	8773.674313
Mean	56.45553715
Median Absolute Deviation (MAD)	38.68784116
Skewness	72.56560029
Sum	3003265.21
Variance	9802.245405

Histogram
Dynamic Histogram

Histogram with fixed size bins (bins=10)

Histogram with variable size bins (bins=[0.000000e+00 1.500000e+00 3.355000e+00 3.815000e+00 3.865000e+00 ... 3.497400e+02 6.040500e+02 1.209875e+03 5.039290e+03 1.414021e+04], "bayesian blocks" binning strategy used)

Value	Count	Frequency (%)
0	6431	12.1%
4	414	0.8%
33.99	203	0.4%
43.99	185	0.3%
53.99	182	0.3%
58.99	153	0.3%
63.99	152	0.3%
28.99	137	0.3%
48.99	133	0.3%
78.99	131	0.2%
Other values (10415)	45076	84.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	6431	12.1%
3	1	< 0.1%
3.33	1	< 0.1%
3.38	1	< 0.1%
3.4	4	< 0.1%

Value	Count	Frequency (%)
14140.21	1	< 0.1%
7781	1	< 0.1%
5272.4	1	< 0.1%
4806.18	1	< 0.1%
3998.99	1	< 0.1%

LowNetPrice
Real number (ℝ_≥0)

SKEWED
ZEROS

Distinct count	11157
Unique (%)	21.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	47.33542343
Minimum	0
Maximum	19138.79
Zeros	1579
Zeros (%)	3.0%
Memory size	415.7 KiB

Quantile statistics

Minimum	0
5-th percentile	6.39
Q1	18.71
median	36.08
Q3	56.98
95-th percentile	111.954
Maximum	19138.79
Range	19138.79
Interquartile range (IQR)	38.27

Descriptive statistics

Standard deviation	139.0497429
Coefficient of variation (CV)	2.937540913
Kurtosis	8523.387876
Mean	47.33542343
Median Absolute Deviation (MAD)	30.23378489
Skewness	78.1880364
Sum	2518102.52
Variance	19334.83101

Histogram
Dynamic Histogram

Histogram with fixed size bins (bins=10)

Histogram with variable size bins (bins=[0.000000e+00 9.750000e-01 3.940000e+00 3.995000e+00 4.005000e+00 ... 6.749200e+02 6.776450e+02 1.059115e+03 2.670110e+03 1.913879e+04], "bayesian blocks" binning strategy used)

Value	Count	Frequency (%)
0	1579	3.0%
23.99	405	0.8%
28.99	347	0.7%
33.99	340	0.6%
18.99	314	0.6%
13.99	313	0.6%
38.99	266	0.5%
43.99	256	0.5%
8.99	235	0.4%
53.99	233	0.4%
Other values (11147)	48909	91.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	1579	3.0%
1.95	1	< 0.1%
2.44	1	< 0.1%
2.68	1	< 0.1%
3	2	< 0.1%

Value	Count	Frequency (%)
19138.79	1	< 0.1%
10003.97	1	< 0.1%
9833.28	1	< 0.1%
9828.14	1	< 0.1%
7781.01	2	< 0.1%

SoldFlag
Boolean

Distinct count	2
Unique (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	415.7 KiB

0	44100
1	9097

Frequency Table

Value	Count	Frequency (%)
0	44100	82.9%
1	9097	17.1%

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Count
Matrix

First rows

	SKU_number	MarketingType	ReleaseNumber	New_Release_Flag	StrengthFactor	PriceReg	ReleaseYear	ItemCount	LowUserPrice	LowNetPrice	SoldFlag
0	266198	S	0	0	1255901	32.50	2004	26	27.57	10.99	0
1	2405151	S	0	0	208404	70.00	1988	21	15.99	40.02	1
2	528384	D	9	1	50339	324.95	2013	53	149.73	123.94	0
3	571691	S	4	1	1361255	39.95	2005	67	10.59	7.59	0
4	2363274	D	1	0	3760024	144.00	2004	13	43.94	33.99	0
5	919625	D	7	1	415071	257.75	2010	50	86.99	45.54	0
6	162332	S	1	0	495212	115.00	2009	14	0.00	81.09	0
7	313692	D	0	0	3687650	37.33	2003	29	45.52	4.33	0
8	621965	S	1	0	34173	49.95	2010	42	26.33	30.98	0
9	109242	S	5	1	2425217	43.03	2005	20	41.49	45.62	0

Last rows

	SKU_number	MarketingType	ReleaseNumber	New_Release_Flag	StrengthFactor	PriceReg	ReleaseYear	ItemCount	LowUserPrice	LowNetPrice	SoldFlag
53187	586770	D	0	0	618038	38.00	2002	32	33.98	15.98	1
53188	895228	S	2	1	637673	54.95	2014	31	49.37	42.28	0
53189	154036	S	3	1	25795	119.50	2009	40	63.30	69.98	0
53190	747156	S	0	0	758835	42.00	1998	35	0.00	21.47	0
53191	639520	S	1	0	647990	67.80	1996	29	80.55	51.08	0
53192	3059530	S	0	0	607526	99.95	2003	22	253.92	99.76	0
53193	57540	D	11	1	362378	30.60	2006	87	93.98	18.97	1
53194	2471534	D	2	1	6046130	40.95	1996	16	0.00	32.48	0
53195	567658	D	8	1	973353	105.95	2008	45	52.69	23.99	0
53196	183696	S	3	1	4138946	242.95	2006	19	13.90	53.89	0

Overview

Variables

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Missing values

Sample

First rows

Last rows